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(57) Abstract: An optical correlator includes an image production device and an image capture device disposed in a common plane. 
An optical device such as a lens or mirror provides a Fourier transform of image information from the image production device onto 
the image capture device. An advantage of embodiments of the invention is its small size. 
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OPTICAL CORRELATOR 



The present invention relates to an optical correlator and to a method of 
correlating. 

5 

The correlation between two variables is a quantity indicating the closeness 
of the relationship between two functions. Where two functions can be precisely 
represented, the relation between them can be determined by an integral known as 
the correlation integral. 

10 

Thus, correlation may be performed computationally, for example in the 
field of digital signal processing. 

In mathematical terms, for an arbitrary first function f(x) and an arbitrary 
15 second function g(x), the correlation integral h(x) is set out in equation (1): 

oo 

Hx)= jf(u)xg(x+u)du (1) 



It is convenient, when providing a measure of the similarity between two 
images, not to form the correlation integral by computation but instead to use 
20 Fourier optics. The Fourier transform of the correlation integral is shown in 
equation (2): . 

F{fc(x)} = F(*)xG*(j) (2) 

25 Where F {h(x)} is the Fourier transform of {h(x)} , F(s) and G(s) are the Fourier 
transforms of f(x) and g(x) respectively and * indicates the complex conjugate. 
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To explain the term "complex conjugate", a complex number expressed as 
x+jy (j is the square root of -1), has a complex conjugate given by x-jy. 

In the field of optics it is well known that a real (as opposed to virtual) 
5 image of the Fourier transform, of an input image is formed using a lens of 
positive optical power, (in other words a converging lens) at the focal plane of the 
lens. 

It is therefore possible to apply two or more images, typically two images, 
10 such as a reference image and a scene image, side-by-side to a positive power lens 
and to form the Fourier transform of the two images at the focal plane of the 
positive power lens. Since the two images are processed together by the lens, the 
power spectrum which is formed is termed the joint power spectrum. By analogy 
with the above discussion of correlation, if the Fourier transform of the reference 
15 and scene images is itself then Fourier transformed to provide a second Fourier 
transform, for example by application to a further positive power lens, then the 
second Fourier transform, referred to as the "joint power spectrum"; is indicative 
of the correlation between the two images. A device employing this technique is 
the subject of US Patent 5511019. 

20 

It will be seen that an optical correlator does not involve the complex 
conjugate: this is because in forming a Fourier transform of light, only the 
absolute value of light amplitude is used. 

25 Image display devices are usually pixellated. Thus the reference and scene 

images which are displayed on the image display devices are discontinuous. 
Now, the mathematical analysis of pixellated systems becomes complicated; 
however, the correlation results obtained using optical Fourier transforms of 
pixellated images are still valid. 
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A number of problems exist with optical correlators. 
One problem is that some types of image display device require an appreciable 
time to load an image. To mitigate this problem the state of the art currently 
5 favours the use of ferroelectric liquid crystal devices which are relatively fast. 

Other problems relate to the size of correlators in which two successive 
Fourier optical systems are required to provide two successive Fourier transforms. 



10 The physical size has to some extent been addressed by earlier attempts to 

build correlators, such earlier attempts using the same Fourier optics for both 
transforming steps in a dual-pass system. For such devices the Fourier transform 
of the reference and scene images is obtained. Then the reference and scene 
image data is removed and the transform is substituted for reference and scene 

15 images. The transform then is applied to the Fourier optics. Nonetheless, the 
length of such a double-pass correlator is relatively large and there is a 
undesirable spatial separation between image display and image capture devices. 
The time to produce a valid correlation result includes the length of time taken to 
read image data to the image production device, the length of time required for 

20 sensing the Fourier transform of the input image and the length of time for 
conveying that Fourier transform information back to the image production 
device, followed by the length of time again to read that information to the image 
production device, and the length of time for the image sensing device to sense 
the second Fourier transformed result. Thus, one of the consequences of the 

25 spatial separation between the input image and the Fourier-transformed resultant 
image is that the length of time taken to provide a correlation result is extended. 

Given that ferroelectric liquid crystal devices are normally two-state 
devices, a time period is also needed for allotting the value 'T 1 or "0" to the 
30 captured image data to allow redisplay on the image production device. In the 
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case of a binary phase device the value "1" corresponds to a "+1" phase shift and 
the value "0" to a "-1" phase shift. 

According to a first aspect of the present invention there is provided an 
5 optical correlator having an image production device, an image capture device and 
an optical device for providing a Fourier transform of image information on the 
image production device at the image capture device, wherein the image 
production device and image capture device are disposed in a common plane. 

10 The common plane in some embodiments is the focal plane of a curved 

mirror. In other embodiments the common plane may be the focal plane of a 
planar mirror with a positive power lens. 

By disposing the image production and capture devices locally to one 
15 another, the correlation speed of the correlator is increased by comparison with 
correlators in which the image production and capture devices are mutually 
remote. The physical size of a correlator having a folded architecture of this sort 
is less than the prior art correlators. 

2 0 Preferably, the image production device and the image capture device are 

integrated on a common substrate. 

By providing a common substrate, the operating conditions of the two 
devices can be made identical. Integration allows manufacturing costs to be 

2 5 minimised, and handling and alignment issues to be addressed. 

In one family of embodiments, the image production device has plural 
image production elements, the image capture device has plural image capture 
elements and the image production elements and the image capture elements are 

3 0 within the image production elements. 
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By forming the elements interspersed or intercalated, the optical system 
does not provide a spatial offset of the image to be captured with respect to the 
image provided by the image production device. It should be borne in mind that 
5 illumination of the image production device is substantially uniform and that 
where the image production and capture elements are interspersed, the 
information content of captured light is formed by subtracting the uniform amount 
from the total incident light. 

10 In a preferred one of this family of embodiments, each image production 

element includes an image capture element. 

The image capture elements may be relatively small by comparison to the 
image production elements so that a regular array of image production elements 
15 each contains an image capture element. 

In another family of embodiments, the image production device and the 
image capture device are spatially separate. 

20 In embodiments where the image production device and image capture 

device are spatially separate, special optical measures are taken to offset the 
resultant image from the optical system with respect to the image on the image 
production device. 

25 Preferably, the correlator comprises at least one positive power optical 

device arranged to receive light from the image production device and to pass 
light back to the image capture device. 

Advantageously, the positive power optical device comprises a curved 

3 0 mirror. 
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Altematively, the positive power optical device comprises a planar mirror 
and a positive power lens. 

5 Instead of a mirror, a fibre array may be used to Told back' the light to the 

image capture device. 

Preferably, the image production device comprises circuitry for applying 
reference image data to one part of the image production device, and circuitry for 
10 providing reference scene data to another distinct part of the image production 
device. 

In one family of embodiments, the image production device provides phase 
modulation of light in response to displayed image data. In another family of 
15 embodiments the image production device provides amplitude modulation of light 
in response to displayed image data. 

Preferably, the image production device has two output levels only. 

20 Advantageously, the image production device comprises a ferroelectric 

liquid crystal on silicon spatial light modulator (FLCOS SLM). 

Alternatively, a nematic liquid crystal on silicon spatial light modulator 
may be used. 

25 

In yet another family of embodiments, a microelectromechanical systems 
(MEMS) modulator is used. 



According to a second aspect to the present invention there is provided a 
3 0 pixellated image capture device for a joint transform correlator, the image capture 
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device being constructed and arranged to provide an electrical signal per pixel 
representative of the quantity of light received at the pixel wherein the image 
capture device is integrated on a silicon substrate, and the integrated device 
further comprises processing circuitry constructed and arranged to compare the 
5 electrical signal of each pixel of the image capture device against a threshold, and 
to provide an output signal per pixel. 

Preferably, the threshold is formed from the electrical signals of at least 
one pixel adjoining the said pixel. 

10 

Preferably, the image capture device further comprises a pixellated image 
production device, and the processing circuitry is constructed and arranged to 
provide each output signal per pixel to a respective pixel of the image production 
device. 

15 

Preferably, the image capture device further comprises output circuitry for 
reading out unprocessed information from each pixel. 

According to a third aspect to the present invention there is provided a 
2 0 method of correlating at least one input image with at least one reference image, 
the method comprising illuminating a representation of the or each input image 
and the or each reference image with coherent light to provide a first light beam; 
passing the first light beam to an optical device disposed to provide a second 
image at a plane, the second image being a Fourier transform of the or each input 
25 image and reference images; wherein the second image is formed co-planar with 
the representation of the or each input image and reference image. 

According to a fourth aspect of the present invention there is provided an 
integrated circuit comprising a liquid crystal on silicon spatial light modulator and 
30 an image capture device, the spatial light modulator having an array of light 
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modulating elements and the image capture device having an array of light 
capture elements, wherein each light capture element is arranged to provide an 
output representative of the light picked up by the respective capture element, the 
integrated circuit further having processing circuitry for each capture element 
5 constructed and arranged to process the output of the said capture element 
together with the output of at least a respective one other capture element and to 
provide a first output from each capture element in response to such processing, 
the capture device further having output circuitry for outputting the unprocessed 
output of each capture element. 

10. 

Two embodiments of the invention will now be described with reference to 
the accompanying drawings in which:- 

Figure 1 shows a block schematic diagram of a first optical joint transform 
1 5 correlator embodying the present invention; 

Figure 2 shows a block schematic diagram of a second optical joint 
transform correlator embodying the present invention; 

20 Figure 3 shows a diagrammatic cross-sectional view through the image 

production and capture device of Figure 1; 

Figure 4 shows elevations of a pixel of the device of Figure 3; 

2 5 Figure 5 shows a block schematic diagram of a part or an image production 

and capture device for use in the invention, incorporating processing and output 
circuitry. 



Figure 6 shows a schematic diagram of processing circuitry of the device 
30 of Figure 3; and, 
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Figure 7 shows a block schematic diagram of a known optical joint 
transform correlator. 

5 Referring first to Figure 7 a prior art dual-pass optical correlator 100 

operates as a binary phase-only correlator. The correlator 100 has a first SLM 101 
and a second SLM 102 arranged side-by-side in a common plane VI -VI'. The 
correlator 100 has a first input line 104 which is connected for applying a 
respective input signal to the first SLM 101. A second input line 103 is connected 
10 to apply an input signal to the second SLM 101. Reference image information is 
supplied over the first input 104 to the first SLM 101; scene image data is applied 
over the second input 103 to the second SLM 102. 

The SLMs 101,102 are transparent and are illuminated from one side, as 
15 shown in the diagram the left-hand side, by collimated laser light 110. The light 
passes into the SLMs 101, 102 and emerges as light 110a, modified by the phase 
shifts imparted by the SLMs 101,102. The SLMs 101, 102 are pixellated and 
each pixel is binary; thus it is only able to provide a selected one of two possible 
phase shifts to light passing through that pixel. Hence the light 1 10a consists of 
20 spatially distinct beams of collimated light having a first or second phase shift 
with respect to the incident light 110. The beam 110a is incident on a Fourier 
converging lens 120 which has a screen 121 in its focal plane. The screen 121 
displays the joint Fourier transform of the reference and scene images. An image 
capture device 130 such as CCD camera 130 is disposed behind the screen 121 to 
25 capture the Fourier image data on the screen 121. The capture device 130 has an 
output 131 to a processing device 140. The processing device 140 has a first 
output 141 which forms a second input to the SLMs 101, 102. The processing 
device 140 also has a second output 142. 
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The joint Fourier transform data picked up by the capture device 130 is 
applied to the processor 140. The image on the screen 121 resulting from the 
application of the reference and scene images at the lens 120 is an analog 
interference pattern. Information derived from this pattern is to be applied to the 
5 binary SLMs 101,102 for a second pass, and hence it is necessary to decide which 
of the binary levels is represented at each pixel of captured data. To do this, the 
processor 140 allots to each of the pixels a brightness value of 1 or 0 according to 
some pre-established criterion. The output 141 of the processor 140 conveys the 
binary information to the SLMs 101, 102- There the information is substituted for 

10 the reference and scene image information as new image data. Light 110 is then 
applied to the new image data displayed on the SLMs 101, 102. Again the light is 
passed through the Fourier lens 120 to be incident on the screen 121. The capture 
device 130 picks up the image data which now represents the correlation between 
the two original input images, namely the reference and scene images originally 

15 applied to the SLMs 101, 102. The correlation data typically consists of two non- 
central bright spots symmetrical about the centre and a central bright spot. The 
central bright spot is the zero-order, i.e. undiffracted content, of the joint power 
spectrum. For the purpose of determining the cross-correlation of the two original 
images, the zero-order may be regarded as unwanted. It may of course be useful 

20 in other respects. 

The data picked up by the capture device 130 is applied again to the 
processor 140 which processes the image to extract information from the non- 
central peaks, outputting this information over the second output 142 as the 
2 5 desired correlation data. 

Referring now to Figure 1, a joint transform correlator 1 receives laser light 
from an optical fibre 2 launched into free-space so as to provide a divergent beam 
3. The divergent beam 3 is incident upon a collimating lens 4 disposed so that its 
30 focal point is coincident with the end of the fibre 2. Other methods of launching 
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coherent light may be substituted for the arrangement shown. 

The collimating lens 4 provides a parallel beam 5 which is incident on a 
beamsplitter 6 here a polarising beamsplitter, although this is not essential. The 
5 polarising beamsplitter 6 is disposed to divert the incident light via 90 degrees to 
provide a beam of light 7 towards an image production and capture device 8 
having an image production portion 8a and an image capture portion 8b arranged 
in a common plane. The image production and capture device 8 in this 
embodiment is a combined ferroelectric liquid crystal spatial light modulator 

10 (FLCSLM) 8a and CMOS smart pixel sensor array 8b, further described herein 
with respect to Figures 3,4 and 5. Between the polarising beamsplitter 6 and the 
device 8 there is a half-wave plate 9 which changes the direction of polarisation of 
light 7 to output light 7a which is incident on the image production and capture 
device 8 for alignment with the liquid crystal to inject the liquid crystal axis for 

15 binary phase. 

The image production portion 8a is pixellated, and as will be later 
described with respect to Figure 2, has an optically-transparent front electrode 
204. In this embodiment, the front electrode 204 is substantially continuous across 

20 the whole of the image production and capture device 8. The front electrode 204 
is disposed over a ferroelectric liquid crystal layer 203, which is in turn disposed 
over a reflective aluminium layer 202. The pixels of the image production portion 
8a are driven to display a information from a reference image r and a scene image 
s, the two images being side-by-side and provided in phase terms. That is to say, 

25 the data of a binary (black and white) image is formed into counterpart first and 
second values of phase shift. 

The image production and capture device 8 may alternatively be in line 
with the fibre 2, i.e. beneath the beamsplitter 6. In a further embodiment, image 
30 production and capture device s 8 are in both locations. In such an embodiment, 
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the laser light may have two wavelength and filters be disposed in front of each 
image production and capture device 8. 

Light 7a passes into the spatial light modulator through the transparent 

5 electrode 204. The phase of the light 7a is changed by the in-plane tilt of the 
ferroelectric liquid crystal layer 203 within the pixel of concern. The light 7a is 
reflected by the aluminium electrodes 202 and passes again through the liquid 
crystal layer 203 and through the transparent electrode 204 to emerge as exiting 
light 17. The exiting light 17 is shifted in phase with respect to the incident light 

0 7a by either a first amount, or a second amount depending on the voltage between 
the front electrode 204 and the aluminium electrodes 202. The exiting light 17 
passes again through the half-wave plate 9 and is incident on the polarising 
beamsplitter 6. Due to the effects of the half-wave plate 9, the majority of the 
light 17 passes straight through the polarising beamsplitter 6 to emerge as light 

5 17a. The light 17a is incident on the reflecting face of a concave curved mirror 10 
which has a focal length f 2 and is located such that its focal plane is at the plane of 
the image production and capture device 8. Thus, collimated light 17a which is 
incident on the curved mirror 10 is reflected back as reflected light 17b to the 
image production and capture device 8 as a focussed image. The distribution of 

0 light 17b across the image production and capture device 8 is an interference 
pattern indicative of the Fourier transform of image data provided by the image 
production portion 8a, 

The correlator 1 further includes a processing unit 20 which has a first 
5 output 21 for loading into the pixellated ferroelectric liquid crystal SLM portion 
8a, two images that are disposed side by sided across the SLM, one image 
representative of the reference image and the other representative of the scene 
image which is to be correlated with the reference image. The processing unit 20 
receives the reference and scene image data r,s at a first input 22. It also has a 
0 second input 23 for receiving data from the pixels of the image capture portion 8b, 
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and a second output 24 at which correlation data are made available. 

In the present embodiment the device 8 contains circuitry 500 (see Figure 
6) for allotting binary values to the light levels received at the pixels of the image 
5 capture portion 8b, and for applying those binary values to the pixels of the image 
production portion 8a. The circuitry 500 in this embodiment consists of clocked 
and gated comparison circuitry. The comparison circuitry 500 compares the 
amount of input light at each pixel with the averaged magnitude of light at the 
four nearest-neighbour pixels. The output 330 of the comparison circuitry 500 
10 provides a T if the light at the pixel is greater, and a ! 0 f if smaller than the 
averaged light magnitude of the nearest neighbour pixels. The circuitry output per 
pixel is thus said to be binarised. The binarised data is connected via a gating 
circuit (not shown) to the corresponding pixel of the image production portion 8a 
of the device 8. 

15 

By forming the comparison circuitry 200 on-chip, the signal transfer times, 
and thus time delays, are reduced. By providing one comparator per pixel, the 
comparison operations can be carried out substantially simultaneously and in 
parallel. This is very time-efficient. 

20 

The image data from the binarised results is then passed through the 
Fourier optics, and the reflected and collected data at the pixels of the image 
capture portion 8b is read out. The data this time is not passed to the comparator 
circuitry 200 but instead is passed to the second input 23 of the processing unit 20. 
2 5 Read-out is typically by a capacitor transfer system similar to a BBD so that the 
input to the processing unit 20 is bit-serial. 

In this embodiment the ferroelectric liquid crystal SLM is a 256 x 256 
pixel device, although other sizes and geometries are possible. 
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Referring now to Figure 3, the device 8 consists of a silicon wafer 250 with 
a circuitry portion 200 on its surface. On the circuitry portion 200 is an oxide 
layer 201 on its surface. On the oxide layer is the aluminium reflective electrode 
5 layer 202. This layer 202 defines the pixels of the image production portion 8a. 
As shown in Figure 4b the aluminium electrodes 202 are substantially square but 
with a square 302 excised from the corresponding corner of each pixel. Returning 
to Figure 3, the excised square 302 forms a window 210 through which access is 
available to the underlying substrate wherein there is disposed a photodiode 220. 

10 Over the aluminium electrodes 202 there is disposed an alignment layer 205 and, 
over the alignment layer 205, there is disposed a liquid crystal 203 which extends 
substantially across the entirety of the SLM. Above the liquid crystal layer 203 
there is a second alignment layer 206 and on top of the second alignment layer 
206 is a transparent electrode 204. The transparent electrode may be ITO or any 

15 other , known transparent electrode material. A spin-on glass coating or other 
encapsulating or covering material (not shown) is disposed over the transparent 
electrode layer 204. 

The circuitry portion 200 is n-type and has, in the region of the window 
20 210, (which it will be understood form a regular array across the substrate) a p- 
dopant heavily implanted into it to form a shallow implanted region 211. A rear 
n+ region 212 is implanted in the window area 210 to act as the rear electrode of 
the photodiode. A front diode electrode 213 is implanted in the window adjacent 
the edge of the oxide 201 to form the anode of the diode. The rear electrode 212 
25 which forms the cathode and the front electrode 213 are connected to circuitry 
(not shown) disposed within the circuitry portion 200, for example disposed under 
the aluminium electrodes 202 via metal or polysilicon conductors. 

The image capture device 8a, as discussed above, captures the joint power 
30 spectrum |R+S| 2 of the two images. The joint power spectrum is defined by 
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equation 3: 

\R + S\ 2 = R*S + S*R + /? 2 + S 2 ^ 

where R is the Fourier transform of the reference imager, S is the Fourier 
5 transform of the scene images to be correlated with the reference image. 

In this relation, the terms R*S and S*R form desired and symmetrical 
correlation terms that appear in the output. The terms R 2 and S 2 relate to the zero- 
order output which appears as a undiffracted central bright spot. 

• 10 

The processing unit 20 receives the data from the pixels and generates 
correlation data from that data by extracting the zero-order bright spot, and 
computing values from the brightness and the separation of the correlation peaks 
in the image data. 

15 

Referring to Figure 4, a portion of an image production and capture device 
8 comprises nine pixels P11-P33 of image production elements and an array of 
nine image capture sensor devices S11-S33. As shown, and as described with 
respect to Figure 3, the capture devices are within a cut-out portion of the 
2 0 production devices PI 1-P33. 

Although in this embodiment the sensor devices S11-S33 are interspersed 
within the production devices P11-P33, the same principles will apply if the 
image production device and the image capture device are separately disposed on 
25 the same substrate. 

The present description relates to the image production device P22 and the 
image capture device S22. It will be understood that similar circuitry will be 
provided for each and every other one of the pixels of the image production and 
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capture device 8 which may have, as previously described, 65K pixels. 

For the pixel P22, S22 there is provided a comparator circuit 500 having 
two inputs 503, 510. The first input 503 is connectable via a switch 502 to the 
5 line 501 from the image capture sensor S22. The second input 510 of the 
comparator 500 is connected to the sensors Sll, SI 3, S31 and S33 which are the 
nearest-neighbouring pixels to the pixel S22, P22. The connection to the second 
input 510 is via switches 51.1, 512, 513, 514. The switch 502 connected to line 
501 may be switched over to an alternative connection in which the line 501 is 
10 connected to a charge transfer device 505 of which only a portion is shown. 

The output 520 of the comparator 500 is connected to the pixel P22 of the 
image production device. 

15 . The comparator 500 is arranged to compare the potential at first input 503 

with the average of the potentials at the sensors Sll, S13, S31 and S33. To do 
this, the switches 511-514 are closed and the comparator then provides a logical 
one output at the output 520 if the first input 503 is above one quarter the potential 
at the second input 510. Thus, provided the light input at the capture device S22 

20 is greater than the average of the light at the capture devices Sll, SI 3, S3 1 and 
S33 then the output 520 will be at logical one. In all other conditions the output 
520 will be. ajt logic zero. Comparators may be provided which operate using 
current or which operate using voltage, as will be described with respects to 
Figure 6. 

25 

In use therefore when the first Fourier transform has been formed on the 
image production and capture device 8, the connection of the switch 502 will be 
as shown. The result is that the comparator 500 which is on the same substrate as 
the other components, will provide an output directly to the image production 
30 pixel P22 and all of the comparator circuits for each pixel will perform the same 
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(non-destructive) comparison. 

Once the first Fourier transform has been formed and the binarised data 
provided to the image production pixels, then the image capture pixels will 
5 receive the joint power spectrum which is required to provide the correlation 
result. The correlation results are processed off chip and to that end the switch 
502 is switched to its second position where it connects to the input line 504 to the 
charge transfer device 505. The charge transfer device has two clock inputs 506, 
507 and operates in a form analogous to a bucket brigade device so that once a 

10 capacitor 520, 521 is charged up to the potential provided by an associated capture 
device S22, suitable clock pulses provided to the clock terminals 506, 507 cause 
the associated transistors 530, 531 to clock-out a series of analogue voltages to the 
output terminal 508. The analogue voltages correspond to the sensors arranged in 
a row of the image production and capture device 8. After outputting the bit- 

15 serial voltages, these are processed as required to provide the relevant 
information. 

Referring now to Figure 6, a comparator circuit 500 compares the output 
voltage from a photodiode 310 of a pixel with the corresponding output voltages 
20 of the four nearest pixels, such voltages being supplied to four input nodes 301- 
304 of the circuit 500. The comparator 500 is a clocked device and has six clock 
inputs 320-3^4. The comparator circuit 500 has an output node 330. The 
structure of the comparator 500 will now be described. 

25 The comparator circuit 500 comprises a source-coupled pair of nFETs 350, 

351. The common sources of the nFETs 350, 351 are connected to reference 
potential 305 via the drain-source path of a current source nFET 352. The drain 
of the first nFET 350 is connected to a positive supply 306 via the drain-source 
path of a first pFET 353 and the drain of the second nFET 351 is connected to the 

30 positive supply 306 via the drain-source path of a second pFET 354. The first 
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nFET is connected to a first line 331 via a transmission gate FET 355 controlled at 
it gate via the second clock input 32 1. The first input line 331 is connected to the 
positive supply 306 via a first p-type pre-charge FET 356 and to the negative 
supply 306 via four quarter-size n-type pull-down FETs 357-360. The quarter 
5 size n-type pull-down FETs each receive at its gate one of the neighbouring pixel 
inputs 301-304. The second n-type FET 351 is connected to a second input line 
332 via a transmission gate FET 361 whose control electrode is provided by the 
third clock input 323. The second input line 332 is connected to the positive 
supply 306 via a second p-type pull-up FET 362 whose gate is connected to the 
10 first clock input 320. The second input line 332 is connected to the reference 305 
via a fifth pull-down FET 363 of unit size, the gate of the fifth pull-down FET 363 
being connected to the photodiode 310. 

The operation of the comparator 500 will now be described. 

15 

Prior to any sensing operation, the clock inputs 320-323 are taken low so as 
to turn off the transmission gates 355 and 361 and to turn on the pre-charge 
transistors 356, 362. The result is that the capacitance of the lines 331 and 332 are 
pre-charged towards the positive supply potential. As the pull-up FET 356, 362 
20 are of identical size and provided the capacitance of the lines 331, 332 are the 
same, the same amount of charge will be stored on the two lines. Measures may 
be needed to ensure that the capacitance of the two lines 331, 332 are the same. 

During this pre-charge interval, the photodiode 310 and the photodiode of 
25 the nearest neighbouring pixels are un-illuminated and, as a result, the transistors 
357-60 and 363 remain off. 

At a given time instant the clock inputs 320 are taken high, thus turning off 
the pull-up transistors 356, 362. At this time illumination is applied to the 
30 photodiode 310 and the photodiodes of the neighbouring pixels so that the line 
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331 and the line 332 are pulled down towards the reference potential 305. If all of 
the photodiodes receives the same amount of illumination, lines 331 and 332 will 
drop at the same rate. This is because the transistors 357-360 are one quarter the 
size of transistor 363. However, if the light applied to photodiode 310 is greater 
5 than the average of the light applied to the photodiodes connected to terminals 
301-304, then the line 332 will be pulled down more rapidly than the line 331. 
After a given time has elapsed, the clock voltages applied to nodes 321 and 323 
are taken high at the same time as the clock voltage applied to nodes 324 and 322. 
This has the effect of connecting the lines 331 and 332 to the gates of transistors 

10 350 and 351. As the common source electrodes of the transistors 350 and 351 are 
taken towards the negative supply by the action of transistor 352, one of the two 
transistors 350 and 351 turns on and the other turns off, according to the 
respective gate voltages applied. As a result, if the second line 332 is at a lower 
potential than the first line 331, then the transistor 350 will turn on and provide a 

15 low potential at output node 330. If instead the first output line 331 is at a lower ■ 
potential than the second line 332, then the transistor 350 remains off and the 
transistor 351 turns on. The result is that the output node 330 remains at the logic 
high state. 

20 An alternative correlator 500 is shown in Figure 2. Here, the image 

production and capture device 8 of Figure 1 is replaced by an integrated circuit 
108 which has an FLC SLM portion 107 and a spatially separate image capture 
portion 106. The image capture portion 106 and the image production portion 107 
are disposed on the same face of the device 108. The image capture portion 106 is 

25 disposed beyond the image production portion 107 and to the side of it. The 
curved mirror 10 is tilted off the axis of the beamsplitter 6 so that the resulting 
Fourier Transform is produced at the image capture portion 106. This allows the 
FLCSLM and CMOS sensor to be separate but integrated on the same substrate. It 
is alternatively possible for the FLC SLM 107 and the sensor 106 to be discrete 

30 units. 
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Separating the FLC SLM 107 and the sensor 106 decreases the complexity. 

The CMOS sensor 106 contains smart pixel technology to perform the 

binarisation process of the captured joint power spectrum- 
Embodiments of the present invention have been described with particular 

reference to the, examples illustrated. However, it will be appreciated that 

variations and modifications may be made to the examples described within the 

scope of the present invention 
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Claims 



1. An optical correlator having an image production device, an image capture 
5 device and an optical device for providing a Fourier transform of image 
information on the image production device at the image capture device, wherein 
the image production device and image capture device are disposed in a common 
plane. 

10 2. An optical correlator according to Claim 1, wherein the image production 
device and the image capture device are integrated on a common substrate. 

3. An optical correlator according to Claim 1 or 2, wherein the image 
production device has plural image production elements, the image capture device 

15 has plural image capture elements and the image capture elements are interspersed* 
with the image production elements. 

4. An optical correlator according to Claim 1 or 2, wherein the image 
production device has plural image production elements, the image capture device 

2 0 has plural image capture elements and each image production element includes an 
image capture element. 

5. An optical correlator according to Claim 1 or 2, wherein the image 
production device and the image capture device are spatially separate. 

25 

6. An optical correlator according to any preceding claim, wherein the 
optical device comprises at least one positive power optical device arranged to 
receive light from the image production device and to pass light back to the image 
capture device. 
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7. An optical correlator according to Claim 6, wherein the positive power 
optical device comprises a curved mirror. 

5 8. An optical correlator according to Claim 6, wherein the positive power 
optical device comprises a planar mirror and a positive power lens. 

9. An optical correlator according to any preceding claim, having circuitry for 
applying reference image data to one part of the image production device, and 

10 circuitry for providing reference scene data to another distinct part of the image 
production device. 

10. An optical correlator according to any preceding claim, wherein the image 
production device is operable to provide phase modulation of incident light 

1 5 according to applied image data. 

11. An optical correlator according to Claim 10, wherein the image production 
device has two output levels only. 

20 12. An optical correlator according to any preceding claim, wherein the image 
production device comprises a ferroelectric liquid crystal on silicon spatial light 
modulator. 

13. An optical correlator according to any one of Claims 1 to 12, wherein the 
25 image production device comprises one from the group comprising a nematic 

liquid crystal on silicon spatial light modulator, a pi-cell spatial light modulator 
and a microelectromechanical systems (MEMS) spatial light modulator. 

14. A pixellated image capture device for a joint transform correlator, the 
30 capture device being constructed and arranged to provide an electrical signal per 
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pixel representative of the quantity of light received at the pixel wherein the 
image capture device is integrated on a silicon substrate, and the integrated device 
further comprises processing circuitry constructed and arranged to compare the 
electrical signal of each pixel of the image capture device against a threshold, and 
5 to provide an output signal per pixel in accordance with the comparison result 

15. A pixellated image capture device according to claim 14, wherein the 
threshold is formed from the electrical signals of at least one pixel adjoining the 
said pixel. 

16. A pixellated image capture device according to claim 14 or 15, comprising 
a pixellated image production device, wherein the processing circuitry is 
constructed and arranged to provide each output signal per pixel to a respective 
pixel of the image production device. 

17. A pixellated image capture device according to claim 16, having output 
circuitry for reading out unprocessed information from each pixel of the image 
capture device. 

20 18. A pixellated image capture device according to claim 16 or 17, wherein the 
pixellated image production device is integrated on the same substrate as the 
image capture, device. 

19. A method of correlating at least one input image with at least one reference 

2 5 image, the method comprising:- 

illuminating a representation of the or each input image and the or each reference 
image with coherent light to provide a first light beam; and, 

passing the first light beam to an optical device disposed to provide a second 
image at a plane, the second image being a Fourier transform of the or each input 

3 0 image and reference images, 
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wherein the second image is formed co-planar with the representation of the or 
each input image and reference image. 

19. An integrated circuit comprising a liquid crystal on silicon spatial light 
5 modulator and an image capture device, the spatial light modulator having an 
array of light modulating elements and the image capture device having an array 
of light capture elements, wherein each light capture element is arranged to 
provide an output representative of the light picked up by the respective capture 
element, the integrated circuit further having processing circuitry for each capture 
10 element constructed and arranged to process the output of the said capture element 
together with the output of at least a respective one other capture element and to 
provide a first output from each capture element in response to such processing, 
the capture array further having output circuitry for outputting the unprocessed 
output of each capture element. 

15 




FIG. 2 

SUBSTITUTE SHEET (RULE 26) 



WO 2004/029746 ^^bl7GB2003/003920 

2/6 




SUBSTITUTE SHEET (RULE 26) 



WO 2004/029746 



3/6 



T/GB2003/003920 



o 



CM 
CM 



CM 
CO 



^1" 
LL 



O 

CM' 

CM 



CD 
LL 



SUBSTITUTE SHEET (RULE 26) 



WO 2004/029746 ^^bT/CB2003/003920 

4/6 




SUBSTITUTE SHEET (RULE 26) 



^^CT/GB2003/003920 

5/6 




SUBSTITUTE SHEET (RULE 26) 



WO 2004/029746 ^^bl7GB2003/003920 

6/6 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



bci matUR 



Internatfa^I , 



PC1W 03/03920 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 606E 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 

EP0- Internal 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 0 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to daim No. 


X 


US 6 247 037 Bl (O'CALLAGHAN MICHAEL J) 
12 June 2001 (2001-06-12) 
abstract; figure 2 


1-13,19, | 
20 


X 


US 6 369 933 Bl (O'CALLAGHAN MICHAEL J) 
9 April 2002 (2002-04-09) 
abstract; figures 2,17 


1-13,19, 
20 


A 


US 5 987 188 A (FREYRE FREDERICK W) 
16 November 1999 (1999-11-16) 
the whole document 


1-13,19, 
20 



Further documents are listed in the continuation of box C. 



m 



Patent family members are listed in annex. 



Special categories of cited documents : 

A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the international 
filing date 

document which may throw doubts on priority daim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

P" document published prior to the international filing date but 
later than the priority date claimed 



T" later document published after the International filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X- document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"V document of particular relevance; the claimed Invention 

cannot be considered to involve an inventive step when the 
document Is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 

15 December 2003 



Date of mailing of the international search report 

1 a 03. 2004 



Name and mailing address of the ISA 

European Patent Office. P.B. 5816 Patentlaan 2 
NL - 2260 HV Rijswijk 
Tel (+31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 



Authorized officer 



Daffner, M 



Form PCT/ISA/210 (second sheet) (July 1992) 



#int^rtonaJ application No. 
SEARCH REPORT ^CT/GB 03/03920 



Box I Observations where certain claims were found unsearchable (Continuation of item 1 of first sheet) 



This International Search Report has not been established in respect of certain claims under Article 17(2)(a) for the following reasons: 
1. FJ Claims Nos.: 

— because they relate to subject matter not required to be searched by this Authority, namely: 



[ | Claims Nos.: 

because they relate to parts of the International Application that do not comply with the prescribed requirements to such 
an extent that no meaningful International Search can be carried out, specifically: 



3. | I Claims Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 



Box II Observations where unity of invention Is lacking (Continuation of item 2 of first sheet) 



This International Searching Authority found multiple inventions in this international application, as follows: 

see additional sheet 



1 . I I As ail required additional search fees were timely paid by the applicant, this International Search Report covers all 
■ 1 searchable claims. 



2. | I As all searchable claims could be searched without effort justifying an additional fee. this Authority did not invite payment 
of any additional fee. 



3. [ I As only some of the required additional search fees were timely paid by the applicant, this International Search Report 
' ' covers only those claims for which fees were paid, specifically claims Nos.: 



4. I y I No required additional search fees were timely paid by the applicant Consequently, this International Search Report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 

1-13, 19-20 



Remark on Protest | | The additional search fees were accompanied by the applicant's protest. 

[ | No protest accompanied the payment of additional search fees. 



Form PCT/ISA/210 (continuation of first sheet (1)) (July 1998) 




FURTHER INFORMATION CONTINUED FROM PCT/ISA/ 210 

This International Searching Authority found multiple (groups of) 
inventions in this international application, as follows: 

1. claims: 1-13,19,20 

An optical correlator, wherein the image production device 
and the image capture device are disposed in a cannon plane 

2. claims: 14-18 

A pixelated image capture device, whith a processing 
circuitry 



INTERNATIONAL SEARCH REPORT 

InfojAdton on patent family members 


International Application No 

PCTJ^03/03920 


Patent document Publication 
cited in search report date 


Patent family 
member(s) 


Publication 
date 



US 6247037 Bl 12-06-2001 US 6369933 Bl 09-04-2002 



US 6369933 


Bl 


09-04-2002 


US 


6247037 Bl 


12-06-2001 


US 5987188 


A 


16-11-1999 


EP 


0583011 A2 


16-02-1994 






JP 


3451264 B2 


29-09-2003 








JP 


6214281 A 


05-08-1994 



